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(57) Abstract 

A method and system for displaying a scries of images capnired by a digital camera, which includes a user interface (430) that 
includes a view finder (402). The method and system fitst stores each of the captured images in memory, and then displays a plurality of 
image cells (418) in the view finder, wherein each of the image cells corresponds to one of the captured images. The method and system 
further provides at least one of the image cells with an image area for displaying the corresponding captured image, and further provides 
the at least one image cell with an icon area for displaying additional information regarding the corresponding capnired image. 
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A METHOD AND SYSTEM FOR DISPLAYING IMAGES 
IN THE INTERFACE OF A DIGITAL CAMERA 

HELD OF THE INVENTION 

The present invention relates generally to digital cameras, and more 
particularly to a method and system for displaying images in the interface of a 
digital camera. 

BACKGROUND OF THE INVENTION 

Modern digital cameras typically include an imaging device which is 
controlled by a computer system. The computer system accesses raw image data 
captured by the imaging device and then processes and compresses the data 
before storing the compressed data into an internal memory. Efficient operation 
of the computer is therefore an important consideration for camera designers and 
manufacturers. The memory architecture of a particular computer system 
determines data storage techniques and can thus significantly effect the 
operational efficiency of the entire digital camera system. 

Due to architectural limitations of conventional digital cameras, there are 
several drawbacks in the user interface that restrict how captured images are 
displayed and manipulated by a user. The user interface in conventional digital 
cameras typically includes a view finder for displaying a series of image cells. 
Each image cell, in turn, displays a small version of a corresponding captured 
image. Displaying several cells in this manner allows a user to review several 
images at once. When the user selects one of the cells in the view finder, the 
full-sized version of the image is then displayed in the view finder. 

One problem with conventional digital cameras is that the file format for 
storing captured images does not directly support the display of image cells. For 
example, most traditional digital cameras store compressed images in a particular 
file format in memory. The file typically includes both a header that optionally 
stores the date aiid time that the image was taken, and the captured image data 
itself. The captured image is usually stored in the file as a Joint Photographic 
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Ej^ert Group (JPEG) data. 

When a conventional digital camera is to display a series of image cells in 
the view finder, the digital camera must first retrieve the JPEG data from the 
appropriate files, decompress the data, and then process the uncompressed 
images by resizing the images to the size of the hnage ceDs. One drawback to 
this approach is that the decompressing and resizing operations reduce the speed 
at which the camera can display the full-sized images in the view finder. 

Another drawback is that the file format for storing captured images does 
not support the storage of additional information regarding each image that may 
be of use to the user. Thus, a conventional digital camera that has stored many 
pictures can only offer the date and time that each image was captured to 
distinguish the images for the user. 

Accordingly, what is needed is an improved system and method for 
displaying captured images in a digital camera. The present invention addresses 



such a need. 



SUMMARY OF THE INVENTION 

The present invention provides method and system for displaying a series 
of images captured by a digital camera that includes a user interface that, which 
includes a view finder. ITie method and system first stores each of the captured 
images in memoiy, and then displays a plurality of image cells in the view finder, 
wherein each of the image cells corresponds to one of the captured images. The 
method and system fiirther provides at least one of the image cells with an image 
area for displaying the corresponding captured unage. and further provides the at 
least one image ceU with an icon area for displaying additional information 
regarding the corresponding captured image. 

According to the system and method disclosed herein, a file format is 
provided that supports the direct display of image cells in the view finder. In 
addition, graphical icons are displayed in the image cell regarding the media 
types associated with the image, thereby increasing the ease of use and operation 
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of the digital camera. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a block diagram of a digital camera that operates in accordance 
with the present invention. 

FIG. 2 is a Mock diagram of the preferred embodiment for the imaging 
device of FIG. 1. 

FIG. 3 is a block diagram of the preferred embodiment for the computer 
of FIG. 1. 

FIG. 4 is a block diagram depicting a user interface for the digital camera. 

FIG. 5 is a block diagram showing a digital camera user interface having 
expanded cells in accordance with the present invention. 

FIG. 6 is a block diagram illustrating the format of an expanded cell. 

FIG. 7 is a table listing example media types and corresponding icons that 
may be associated with a captured image. 

FIG. 8 is a block diagram of one preferred embodiment for a extended file 
format for storing a captured image that supports the display of thumb nail 
images in accordance with the present invention. 

FIG. 9 is a block diagram of a second preferred embodiment for the 
extended file format that supports multiple media types. 

FIG. 10 is a block diagram illustrating a multiple image file format that 
supports multiple image media types. 

DESCRIPTION OF THE INVENTION 

The present invention relates to an improvement in displaying images in a 
digital camera. The following description is presented to enable one of ordinary 
skill in the art to make and use the invention and is provided in the context of a 
patent application and its requirements. Various modifications to the preferred 
embodiment will be readily apparent to those skilled in the art and the generic 
principles herein may be applied to other embodiments. Thus, the present 
invention is not intended to be limited to the embodiment shown but is to be 
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accorded the widest scope consistent with the principles and features described 
herein. 

TTie present invention is a digital camera that includes a method and 
system for displaying captured images in a digital camera. According to the 
present invention, a method and system is provided for supporting the direct 
display of image cells in the view finder, and for extending the image cell of each 
image in order to provide additional information regarding the image. 

A digital camera architecture has been disclosed in co-pending U.S. Patent 

Application Serial No. , entitled "A System And Method For Using A 

Unified Memoiy Architecture To Implement A Digital Camera Device.," filed on 

, 1996, and assigned to the Assignee of the present application. The 

Applicant hereby incorporates the co-pending application by reference, and 
reproduces portions of that application herein with reference to FIGS. 1-3 for 
convenience. 

Referring now to FIG. 1. a block diagram of a camera 110 is shown 
according to the present invention. Camera 110 preferably comprises an imaging 
device 114, a system bus 116 and a computer 118. Imaging device 114 is optically 
coupled to an object 112 and electrically coupled via system bus 116 to computer 
118. Once a photographer has focused imaging device 114 on object 112 and. 
using a capture button or some other means, instructed camera 110 to capture an 
image of object 112, computer 118 commands imaging device 114 via system bus 
116 to capture raw image data representing object 112. The captured raw unage 
data is transferred over system bus 116 to computer 118 which perfonns various 
image processing functions on the image data before storing it in its internal 
memoiy. System bus 116 also passes various status and control signals between 
imaging device 114 and computer 118. 

Referring now to FIG. 2, a block diagram of the preferred embodiment of 
imaging device 114 is shown. Imaging device 114 preferably comprises a lens 220 
having an iris, a filter 222, an image sensor 224, a timing generator 226, an 
analog signal processor (ASP) 228, an analog-to-digital (A/D) converter 230, an 
interface 232, and one or more motors 234. 
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U.S. Patent Application Serial No. 08/355,031, entitled "A System and 
Method For Generating a Contrast Overlay as a Focus Assist for an Imaging 
Device," filed on December 13, 1994, is incorporated herein by reference and 
provides a detailed discussion of the preferred elements of imaging device 114. 
Briefly, imaging device 114 captures an image of object 112 via reflected light 
impacting image sensor 224 along optical path 236. Image sensor 224 
responsively generates a set of raw image data representing the captured image 
112. The raw image data is then routed through ASP 228, A/D converter 230 
and inter&ce 232. Interface 232 has outputs for controlling ASP 228, motors 234 
and timing generator 226. From interfoce 232, the raw image data passes over 
system bus 116 to computer 118. 

Referring now to FIG. 3, a block diagram of the preferred embodiment 
for computer 118 is shown. System bus 116 provides connection paths between 
imaging device 114, power manager 342, central processing unit (CPU) 344, 
dynamic random-access memory (DRAM) 346, input/output interface (I/O) 348, 
read-only memory (ROM) 350, and buffers/connector 352. Removable memory 
354 connects to system bus 116 via buffers/connector 352. Alternately, camera 
110 may be implemented without removable memory 354 or buffers/connector 
352. 

Power manager 342 communicates via line 366 with power supply 356 and 
coordinates power managraient operations for camera 110. CPU 344 typically 
includes a conventional processor device for controlling the operation of camera 
110. In the preferred embodiment, CPU 344 is capable of concurrently running 
multiple software routines to control the various processes of camera 110 within a 
multi-threading environment. DRAM 346 is a contiguous block of dynamic 
memory which may be selectively allocated to various storage functions. 

I/O 348 is an interface device allowing communications to and from 
computer 118. For example, I/O 348 permits an external host computer (not 
shown) to connect to and communicate with computer 118. I/O 348 also permits 
a camera 110 user to communicate with camera 110 via an external user interface 
and via an external display panel, referred to as a view finder. 
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ROM 350 typically comprises a conventional nonvolatile read-only 
memoiy which stores a set of computer-readable program instructions to control 
the operation of camera 110. Removable memoiy 354 serves as an additional 
image data storage area and is preferably a non-volatile device, readily removable 
and replaceable by a camera 110 user via buffeiVconnector 352. Thus, a user 
who possesses several removable memories 354 may replace a full removable 
memoiy 354 with an empty removable memoiy 354 to effectively expand the 
picture-taking capacity of camera 110. In the preferred embodiment of the 
present invention, removable memory 354 is typically implemented using a flash 
disk. 

Power supply 356 supplies operating power to the various components of 
camera 110. In the preferred embodiment, power supply 356 provides operating 
power to a main power bus 362 and also to a secondaiy power bus 364. The 
main power bus 362 provides power to imaging device 114, I/O 348, ROM 350 
and removable memoiy 354. The secondaiy power bus 364 provides power to 
power manager 342, CPU 344 and DRAM 346. 

Power supply 356 is connected to main batteries 358 and also to backup 
batteries 360. In the preferred embodiment, a camera 110 user may also connect 
power supply 356 to an external power source. During normal operation of 
power supply 356, the main batteries 358 provide operating power to power 
supply 356 which then provides the operating power to camera 110 via both main 
power bus 362 and secondary power bus 364. 

During a power faflure mode in which the main batteries 358 have failed 
(when their output voltage has fallen below a minimum operational voltage level) 
the backup batteries 360 provide operating power to power supply 356 which then 
provides the operatmg power only to the secondary power bus 364 of camera 1 10. 
Selected components of camera ilO (including DRAM 346) are thus protected 
against a power failure in main batteries 358. 

Power supply 356 preferably also includes a flywheel capacitor connected 
to the power line coming from the main batteries 358. If the main batteries 358 
suddenly fail, the flywheel capacitor temporarily maintains the voltage from the 
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main batteries 358 at a sufficient level, so that computer 118 can protect any 
image data currently being processed by camera 110 before shutdown occurs. 

According to the present invention, the flexible architecture of the digital 
camera provides an improved method for displaying captured images in a digital 
camera. More specifically, the present invention provides a method and system 
for directly displaying image cells and for extending the cells of each image, such 
that the cells contain additional information regarding the image. In a preferred 
embodiment, image cells are extended through the use of an extended file 
format, and the additional information contained in the extended image cells 
takes the form of graphical icons, as explained further below. 

FIG. 4 is a block diagram depicting a user interface 400 for the digital 

camera as described in co-pending U.S. Patent Application Serial No. , 

entitled **A Method and System For Grouping Images In A Digital Camera," and 
assigned to the Assignee of the present application. In one preferred 
embodiment, the user interface includes a view finder 402, an image capture 
button called a photo button 404, a four-way navigation control button 406, a 
menu button 408, a menu area 410 within the view finder 402, and function keys 
412. The user interface may also include an optional sound button 414 and a 
mode button 416. 

Referring again to FIGS, 1 and 4, the user interface 400 operates in two 
modes: view finder mode and review mode. In a preferred embodiment, the 
photo button 404 is a two position button. The view finder mode begins when a 
user aims the camera at an object 112 and presses the photo button 404 into the 
first position. Once this occurs, the view finder 402 displays the image of the 
object 112 as shown through the camera's imaging device 114. The user may 
then press the photo button 404 into the second position to capture the image 
shown in the view finder 402. Review mode begins by pressing any other button 
on the interface 400. 

Referring again to Figure 4, once in the review mode, the view finder 402 
displays a series of cells 418 that represent the digital images that have been 
captured in the digital camera. The view finder 402 is shown here as displaying 
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nine image cells 418. Each cell 418 displays a small-sized image corresponding to 
one of the captured images. The user may navigate through the series of 
displayed cells 418 in the view finder 402 using the four-way navigation control 
button 406 in order to select which image is displayed full-sized in the view finder 
402. The cell 418 currently selected by the four-way navigation control 406 is 
encircled with a highlighted area 419, which is shown as a selection rectangle. 
Other shapes for the highlighted area are also suitable. 

Although the user interface 400 provides many advantages, the cells 418 
for displaying captured images suffer the same drawbacks as the cells used in 
conventional digital cameras. The principal drawbacks being a general failure in 
aiding the user in distinguishing among the captured images, and the requirement 
of processing each captured image in order to display its corresponding image 



cell 418. 



According to the present invention, the failure of aiding the user in 
distinguishing among captured images is addressed by expanding the image cells 
418, and by including additional information in the expanded image cells 418. 
besides a small graphic of the captured image. 

FIG. 5 is a block diagram showing a digital camera user interface 430 
displaying a series of expanded cells 420 in accordance with the present 
invention. The user interface 430 is also shown with another preferred 
embodiment for the layout of the interface buttons, where like components in 
FIGS. 4 and 5 have like reference numerals. 

FIG. 6 is a block diagram iUustrating the format of an expanded cell 420. 
According to the present invention, each cell 420 includes an image area 422 and 
an icon/information area 424. The icon/information area 424 may be placed in 
various positions relative to the image area 422. However, in a preferred 
embodiment, die icon/information area 424 is displayed on the right-hand side of 
each cell 420 as shown. 

The icon/information area 424 is for displaying one or more graphical 
icons, and/or for displaying text information. The icons and text information 
displayed in the icon/information area 424 indicate to tiie user what media types 
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have been associated with the image displayed in the image area 422. As used 
conventionally, the phrase "associating a media type with an object" means 
identifying the specific types of media included in that object, such as graphics, 
text, and sound. 

FIG. 7 is a table listing example media types and corresponding icons that 
may be associated with a captured image. The media type of a captured image 
may represent a single image, a time l^se or burst image, a movie clip, or a 
panorama. The media type may also represent sound, where the corresponding 
icon indicates that a sound clip is attached to the image displayed in the image 
area 422. 

Other media types may also be associated with a captured image that are 
not shown in FIG. 7, such as a slide show and a folder, for example. A slide 
show comprises several images stored sequentially in the same file, while a folder 
is one or more images stored in the directory or folder. With such media types, 
the image area 422 would display the first image in the group or a representative 
image from the folder, and the icon/information area 424 would display an 
graphical icon representing a slide show or folder, respectively. 

Displaying icons and text information in the icon/information area 424 
according to the present invention provides the user with an automatic method 
for categorizing and identifying common groups of captured images. 

The present invention also eliminates the need for processing captured 
images when displaying the image cells 420. This is accomplished by extending 
the file format used to store the captured images. 

FIG. 8 is a block diagram of one preferred embodiment for a extended file 
format 460 for storing a captured image in accordance with the present invention. 
The extended file format 460 includes a standard header 462 for storing the date 
and time the image was captured, and JPEG data 464 representing the captured 
image in compressed form. And in contrast to prior file formats, the extended 
file format 460 also includes a small version of the captured image, referred to 
here as a thumb nail image 466. 

Including the thumb nail image 466 in the extended file format 460 
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enables the digita] camera to directly display an image in the image area 422 
without processing the JPEG data 462. When the digita] camera 118 is to display 
a series of image cells 420 in the view finder 402, the corresponding file formats 
460 are first retrieved from memory. The digital camera 118 then displays the 
thumb nail image 466 direcUy from the file 460 in the image area 422 of the cell 
420, rather than first decompressing and resizing the JPEG data 464. Avoiding 
the processing the actual JPEG data 464 in this manner improves the speed at 
which the camera 118 may display the series of image cells 420 in the view finder 
402. 

FIG. 9 is a block diagram of a second preferred embodiment for the 
extended file format 470 that supports multiple media types. As in the previous 
embodiment, the extended file format 470 includes a standard header 462*, JPEG 
data 464', and a thumb nail image 466'. To enable different media types to be 
associated with a captured image, the extended header 470 also includes an 
information field 472 and a sound field 474. 

The information field 472 comprises a series of tags for storing 
information regarding the image represented by the JPEG data 464*. Media type 
tags indicate the media type of the image, such as whether the image is a single 
image or a panorama image, for example. The media type tags are used to select 
the type of icon is displayed in the icon/information area 424 of a cell 420 when 
the thumb nail 466 of the image is displayed. 

In operation, when the digital camera 118 is required to display a set of 
cells 420 in the view finder 402, the digital camera 118 first retrieves each image's 
extended file 470 fi-om memoiy. After the appropriate file is retrieved, the 
thumb nail 466' is displayed in the image area 422 of the cell 420. While the 
thumb nail is being displayed, the tags stored in the infonnation field 472 are 
read. Based on the content of the tags, the appropriate icon is then displayed in 
the icon/information area 424 of the cell 420. 

Besides media tags, the information field 472 may also include other types 
of tags for storing additional information regarding the image and/or the camera 
118 itself. For example, a tag could be used to indicate the settings of the 
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camera 118 at the time the image was captured, or indicate the identity of the 
camera manufacturer, for instance. The information in these tags may be 
accessed through the buttons on the camera interface 430. The information may 
then be displayed either as text in the icon/information area 424, or displayed in 
a dialog box that is displayed in the view finder 402. 

Displaying media icons and other information in the icon/information area 
424 provides the advantage of indicating to the user information regarding the 
images that the user otherwise would not have inmiediate access to. This feature 
provides a digital camera interface that is both ea^ to user and more user 
friendly than traditional interfaces. 

Referring still to FIG. 9, as stated above the expanded file format 470 also 
includes a sound field 474. The sound field 474 contains digital sound data that 
has been recorded for the image using the sound button 414, or contains a sound 
clip that has otherwise been associated with the image. When the user selects 
one of the cells 420 in the view finder 402, the full-sized image is displayed in the 
view finder 402 from the JPEG data 464, while sound is played using the sound 
from the sound field 474. 

The extended file format 470 of the present invention also supports 
multiple image media types. Multiple image media types are media types that 
comprise more than one image. Examples include a timelapse, a slide show and 
a movie clip. In multiple image media types, the multiple images are preferably 
stored in one file. 

FIG. 10 is a block diagram illustrating a multiple image file format 480 
that supports these multiple image media types. As shown, the multiple image 
file format 480 preferably includes a series of extended file formats 470 that 
correspond to each image in the multiple image file. The multiple image file 
format 480 also includes a header 482 pointing to each of the extended file 
formats 470*. In operation, the file is retrieved and the header 482 is read in 
order to sequentially access each of the extended file formats 470. Each of the 
extended file formats 470 are then used to display their respective images in the 
view finder 402. Other formats for the multiple image file format 480 may also 
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be used. For example, the file fonnat 480 could comprise only one header 482. 
one thumbnail, and multiple JPEG data files. 

A method and system for displaying images in the interface of a digital 
camera has been disclosed. Although the present invention has been described in 
accordance with the embodiments shown, one of ordinary skill in the art will 
readily recognize that there could be variations to the embodiments and those 
variations would be within the spirit and scope of the present invention. 
Accordingly, many modifications may be made by one of ordinaiy skill in the art 
without departing from the spirit and scope of the appended claims. 
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CL4IMS 

What is claimed is: 

L A method for displaying a series of images captured by a digital 
camera, the digital camera including a user interface that includes a view finder, 
the method comprising the steps of: 

(a) storing each of the captured images; 

(b) displaying a plurality of image cells in the view finder, 
wherein each of the image cells corresponds to one of the captured images; 

(c) providing at least one of the image cells with an image area 
for displaying the corresponding captured image; and 

(d) providing the at least one image cell with an icon area for 
displaying additional information regarding the corresponding captured image. 

2. A method as in claim 1 wherein a plurality of media types may be 
associated with each of the captured images, wherein step (d) further includes the 
steps of: 

(dl) providing a graphical icon representing each of the plurality 
of media types; and 

(d2) displaying the graphical icons corresponding to the media 
types associated the captured image in the icon area of the at least one image 
cell. 

3. A method as in claim 2 wherein step (a) further includes the step 

of: 

(al) storing each of the captured images in a file format that 
includes compressed image data and thumb nail image data. 

4. A method as in claim 3 wherein step (c) further includes the step 

of: 

(cl) displaying the captured image in the at least one image cell 
by displaying the thumb nail image data from the respective file format. 
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of: 



5. A method as in claim 4 wherein step (a) further includes the step 



(a2) storing media type inforaiation in the file format regarding 
the media types associated with the respective captured images. 

6. A method as in claim 5 wherein step (d) further includes the step 

of: 

(d3) displaying text in the icon area of the at least one image cell 
corresponding to the media type information stored in the file format. 

7. A method as in claim 6 wherein step (a) further 
includes the step of: 

(a3) storing media types comprising multiple images in a multiple 
media type file format, the multiple media type format including plurality of file 
fonnats for each of the multiple images, and a header for pointing to each of the 
file formats. 

8. A system for displaying a series of images captured by a digital 
camera, the digital camera including a user interface that includes a view finder, 
the system comprising: 

means for storing each of the captured images; and 
means for displaying a plurality of image cells in the view finder, 
each of the image cells corresponding to one of the captured images, wherein at 
least one of the image cells including an image area for displaying the 
corresponding captured image, and an icon area for displaying additional 
information regarding the corresponding captured image. 

9. A system as in claim 8 wherein a plurality of media types may be 
associated with each of the captured images, wherein the system further includes 
means for providmg a graphical icon representing each of the plurality of media 
lypes. and means for displaying the graphical icons corresponding to the media 
types associated the captured image in the icon area of the at least one image 
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cell. 

10. A system as in claim 9 wherein each of the captured images are 
stored in a file format that includes compressed image data and thumb nail image 
data. 

11. A system as in claim 10 wherein the captured image is displayed in 
the at least one image cell by displaying the thumb nail image data from the 
respective file format. 

12. A system as in claim 1 1 wherein media type information for each 
captured image is stored in a respective file format. 

13. A system as in claim 12 wherein text is displayed in the icon area of 
the at least one image cell corresponding to the media type information stored in 
the file format 

14. A system as in claim 13 wherein media types comprising multiple 
images are stored in a multiple media type file format, the multiple media type 
format including plurality of file formats for each of the multiple images, and a 
header for pointing to each of the file formats. 

15. A digital camera device comprising: 

a memory device coupled to the digital camera device for storing sets of 
image data; 

a memory manager for allocating storage locations within the memory 
device to store the sets of image data, the image data stored in a file format that 
includes the image data, a thumb nail image of the image data, and an 
information field for storing information regarding the image data; and 

an interface coupled to the memory device for displaying a plurality of 
image cells corresponding to the image data, wherein at least one of the image 
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cells includes an image area for displaying the thumb nail image of the 
corresponding image data, and an icon area for displaying additional information 
regarding the corresponding image data. 



1/8 



PCT/US97/16183 



110 







114 




118 






Imaging 




Computer 






^ 


Device 


' i ' 
116 













FIG. 1 



SUBSTITUTE SHEET (RULE 26) 



wo 98/12868 



PCTAJS97/16183 



2/8 




(N 

d 



SUBSTITUTE SHEET (RULE 25) 



wo 98/12968 



PCT/US97/16183 



3/8 




Oh 
O 

u 



r4 



00 


o 








I 






CO 


CO 




0) 
























CO 






m 


CD 




Q- 


c 






Mai 




Back 



CO 

CD 
o 

0- 



(0 

c 

8 

(D 
CO 



CO 

CO 
a> 
o 

C 




00 



SUBSTITUTE SHEET (RULE 26) 



PCT/US97/16183 



4/8 




SUBSTITUTE SHEET (RULE 26) 



wo 9S/12868 



PCT/US97/16183 



5/8 




SUBSTITUTE SHEET (RULE 26) 



W0 9S/12868 



PCTAJS97/16183 



6/8 



Single 

Image 420- 
Cell 




Image Area 
422 



Icon/Info Area 
424 



FIG. 6 



Icon 


Icon Key 


□ 


Single Image 




Time Lapse or Burst 


i 


Movie Clip 


iiiinin 


Panorama 




Sound Attached 



FIG. 7 

SUBSTITUTE SHEET (RULE 26) 



wo 98/12868 



PCT/US97/16183 



7/8 



460 



HEADER 




JPEG 


^-^464 


DATA 


THUMB NAIL 


"^^466 



FIG. 8 



470 



HEADER 


^^^462' 


JPEG 




DATA 


■^^464* 


THUMB NAIL 


~^^466' 


INFO. FIELD 


■^^472 


SOUND FIELD 





HG. 9 

SUBSTITUTE SHEET (RULE 26) 



wo 98/12868 



PCT/US97/16183 



8/8 



480 



FIG. 10 




JPEG 
DATA 



THUMB NAIL 



INFO. FIELD 



SOUND FIELD 



482 



SUBSTITUTE SHEET (RULE 26) 



INTERNATIONAL SEARCH REPORT 



Intenntional application No. 
PCT/US97/16183 



A. CLASSinCATION OP SUBJECT MATTER 
IPC(6) : H04N 5/225, 5/232 

US CL : 348/333, 334. 231, 232, 233; 345/326. 327, 348 
Accoriing to International Patent ClaaaificatiDa (IPC) or to twth national daaaificatioii and IPC 

R FIELDS SEARCHED — 

Mitttmum documcMtation learched (cUBailiGation ayitem followed by claasification aymbols) 
as. : 348/333, 334. 231, 232, 233; 345/326, 327, 348 

p^^»fnm»«*i»n ifmrohftd ^>Oht tfi^n fniftf«i"fn ''^m^'ft"*^ ^ ^ tsgjeat that aueh doeumenti m tncluded in the fieids aeaiched 



Electionic data baae oonaulted during the intemational aearch (name of data baae and, vAittc practicable, search tcnns used) 



C DOCUMENTS CONSIDERED TO BE RELEVANT 





CilBtion of dftWiment, wUi indioatkm, w^iere a|)propnalc, of the relevant passages 


Relevant to claim No. 


Y 

y 

Y 

Y.P 

A 
A 


US 5,164,831 A (KUCHTA ET AL) 17 November 1992, col. 4, 
lines S3-6S, col. 7, lines 47-52. 

US 5,161,025 A (NAKAO) 03 November 1992 col. 4, line 63 - coL 
5, line 56. 

US 5,124,814 A CTAKAHASHI ET AL) 23 June 1992, Figure 4. 

US 5,633,678 A (PARULSKI ET AL) 27 May 1997, coL 5, lines 8- 
17, coL 6, lines 17-22. 

US 4,827,347 A (BELL) 02 May 1989, Figure 1. 
US 5,528,293 A (WATANABE) 18 June 1996. 


1-15 
1-15 

1-15 
1-15 

1-15 
1-15 


n IHmhcr il Bill wh le IhlBd fa the coatimiilioa of Bw C. Fl See |Mteat bmily annex. 


Jill mI ml !■ TWilift TTlh Ifc* Tfl '' *— -•* — ' *— »— 

IB pMtwilwilivMn 

MriMT pHlihihiil OB ar tftw «M iniiiraihriiiil Ci^t ■ iiw 1 il i ii li i or ammt b> aowidiw J to hwoly «n immm mmp 
•L" 4o«»«rt wMA mmf daow aowMi — priBrt» ^hi^t) or wMdi it wh«i ^ aoou««i t» iriMB olott. 

■M^^MMoa'te I^I^Ia^^^ *itilwm or a^tf . jB«uM«ot of paitwakr nltvaace; Uw daioisd iovMtiaB caanoi b» 
* ^ outkkioJ to iarolvc «d invMitiv* tiap whm tfao doaoBoat n 

"O** ill 1— nil nfwiii^ III M mil <iiiiliiiwi. mi. ■■aililiiM Ilwi oesbiMd witti omotboi* edm mch doeuB«Bli,«ueheeaibiDMioB 

b*"* obvaom lo a panoo •kiDad in llw art 

•r - <loaBBaBt pdN»fca< prior lo tta IbIwHiiimI fOm diia biiHrtw tbaa doowM waabar af tha lama potoot totly 
priority drta olainad 


Date of the fMihpil ownplftipn of the uWTnf'ff^Tiftl aearch 
17 NOVEMBER 1997 


Dale of mailing of the inteniational search report 

2 3 OEC 1JII7 


Name and mailing addreat of ttejSA/US 
Box PCT 

WMhB«iaa,D.C 20231 
Paeaimik No. (703) 305-3230 


Authorized officer , . 

Jp^WENDY R. GARBER vjgo BlJU' 
felephoDe No. (703) 305^929 



Form PCT/ISA/210 (aeooad ihect)(Jiily 1992)* 



THIS PAGE BLANK (USPTO) 



This Page is Inserted by IFW Indexing and Scanning 
Operations and is not part of the Official Record 

BEST AVAILABLE IMAGES 

Defective images within this document are accurate representations of the original 
documents submitted by the applicant. 

Defects in the images include but are not limited to the items checked: 

03^ACK BORDERS 

□ IMAGE CUT OFF AT TOP, BOTTOM OR SIDES 
(HEADED TEXT OR DRAWING 

La BLURRED OR ILLEGIBLE TEXT OR DRAWING 

□ SKEWED/SLANTED IMAGES 

□ COLOR OR BLACK AND WHITE PHOTOGRAPHS 

□ GRAY SCALE DOCUMENTS 

□ LINES OR MARKS ON ORIGINAL DOCUMENT 

□ REFERENCE(S) OR EXHIBIT(S) SUBMITTED ARE POOR QUALITY 

□ OTHER: .. _^ . 

IMAGES ARE BEST AVAILABLE COPY. 
As rescanning these documents will not correct the image 
problems checked, please do not report these problems to 
the IFW Image Problem Mailbox, 



THIS PAGE BLANK luspfo) 



